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APPARATUS AND METHOD FOR THE AUTOMATED MARKING OF DEFECTS 
5 ON WEBS OF MATERIAL 

Technical field 

The present invention relates to automated inspection systems, and more particularly 
to a system and device for marking moving webs so as to identify the specific location of 
10 defects. 



Background 

Inspection systems for the analysis of moving web materials have proven critical to 
modern manufacturing operations. Industries as varied as metal fabrication, paper, non- 
15 wovens, and films rely on these inspection systems for both product certification and online 
process monitoring. They provide value in two major areas. First, they can be used to 
measure and report product quality in real-time, thereby enabling continuous optimization of 
the manufacturing process. Second, they are used to identify defective material, enabling that 
material to be segregated before shipment to the customer. Unfortunately, accurate 
20 identification of defective areas can be extremely difficult depending on the nature of the web 
combined with the time and place of product converting. 

Methods of identifying defective regions range from grading rolls using electronic 
maps to various marking mechanisms. Grading rolls is adequate if one wants to judge bulk 
statistics of the web. However, in order to remove specific defective regions the roll must be 
25 re-inspected. Markers tend to be used to mark only the web edge, and in many cases this is 
sufficient. Once the mark is identified on the web edge, one usually removes the defective 
portion. Unfortunately, there are more situations arising where edge marking of webs is not 
sufficient. These include: 

1) Defects difficult to later identify such that even with the presence of an edge mark 
30 humans may have a very difficult time finding the defect. Wide webs and small defects 
compound this situation. 
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2) Situations where the initial roll is slit into smaller rolls such that the edge mark is no 
longer present on the narrower rolls. 

Besides these difficulties, another concern is raised by the desirability in 
manufacturing to produce product "just-in-time". Manufacturing product only when 
5 customers require it allows industry to reduce its inventory of finished goods, which results in 
savings to consumers. However, achieving this goal often has manufacturers working to 
develop systems and devices that allow a rapid change over between various products. 

Summary of the invention 

10 Web inspection and defect marking fields are further benefited by the present system 

through which the marking is deferred from the time of inspection. This allows the 
identification of only those blemishes that are considered defects with respect to the 
contemplated end use of the web, even when that end use is selected "just-in-time," 
immediately prior to the final converting of the web into its finished form. 

15 The present invention provides a system for the characterization of webs that permits 

the identification of anomalous regions on the web to be performed at a first time and place, 
and permits the localization and marking of actual defects to be performed at a second time 
and place. This allows the selection of what constitutes an actual defect with respect to the 
contemplated end-use of the web to be made "just-in-time". Material waste is reduced since 

20 the criteria of what constitutes defects that would disqualify a portion of the web for a 

particular end use no longer needs to be equivalent to that used for the most demanding end- 
use applications. 

In a first aspect, the invention can be thought of as a method of analyzing the 
characteristics of a web of material, comprising: 
25 imaging a sequential portion of the web to provide digital information; 

processing the digital information with an initial algorithm to identify regions on the 
web containing anomalies; 

placing fiducial marks on the web; 

recording positional information localizing the identified regions relative to the 
30 fiducial marks; and 
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applying locating marks to the web identifying the position of at least some of the 
anomalies, using the positional information and the fiducial marks as a guide. 

In most of the convenient embodiments of the method, the position of only the 
anomalies that qualify as actual defects with respect to the contemplated end use of the web 
5 are identified with locating marks. In carrying out the method, it is frequently advantageous to 
further carry out extracting identified regions from the digital information, and analyzing the 
extracted identified regions with at least one subsequent algorithm to determine which 
anomalies represent actual defects with respect to the contemplated end use of the web. The 
steps are conveniently accomplished using techniques disclosed in the copending and 

10 coassigned U.S. patent application 10/669,197, "Apparatus And Method For Automated 
Inspection Of Moving Webs By Reprocessing Image Information" (Attorney Docket No. 
58695US002), which is hereby incorporated by reference in its entirety. 

Following the guidance of the just mentioned reference, it will frequently be 
advantageous to perform a storing or buffering of the identified regions prior to analyzing 

15 them, even to such an extent that the stored or buffered information is analyzed after the 
imaging has been performed on the entire web. When it is convenient for the user of the 
method to perform the identification of anomalous regions on the web at a first time and place 
and perform the localization and marking of actual defects at a second time and place, it will 
usually also be convenient to perform a winding of the web onto a roll between the placing 

20 step and the applying step. The wound roll can then be shipped to a convenient place along 
with the stored information about its surface anomalies, where it can there wait for a decision 
to be made about application of the roll to a specific end-use. Depending on the exact end-use, 
it may be convenient to place the locating marks on or adjacent to the anomalies whose 
position they identify, or it may be convenient to place the locating marks such that they are 

25 spaced in a predetermined way from the anomalies whose position they identify. 

In the second aspect, the invention is a system for marking a web of material. The 
system includes a fiducial marker for applying fiducial marks to the web and an inspection 
module for imaging a sequential portion of the web to provide digital information, processing 
the digital information with an initial algorithm to identify regions on the web containing 

30 anomalies, and recording positional information localizing the identified regions relative to 
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the fiducial marks. The system also includes a fiducial reader for reading and providing 
localizing information from the fiducial marks, a web marker for applying locating marks to 
the web, and a web marker controller for controlling the web marker so as to apply locating 
marks to the web identifying the position of at least some of the anomalies, using the 
5 positional information and the localizing information as a guide. 

In a preferred embodiment, the web marker applies locating marks identifying the 
position of only the anomalies that qualify as actual defects with respect to a contemplated end 
use of the web. In such embodiments, it is advantageous to arrange for the inspection module 
to extract identified regions from the digital information. Then the system may further include 

10 a processor associated with the web marker controller for analyzing the extracted identified 
regions with at least one subsequent algorithm to determine which anomalies represent actual 
defects with respect to the contemplated end use of the web. 

The user of the system may perform the identification of anomalous regions on the 
web at a first time and place and perform the localization and marking of actual defects at a 

15 second time and place. In this instance, it is usually also convenient to have the inspection 
module store or buffer the identified regions for the processor. In certain embodiments, the 
fiducial marker and the inspection module may be associated with a first web handling 
apparatus, and have the fiducial reader, the web marker, and the web marker controller be 
associated with a second web handling apparatus. 

20 Other features and advantages will be apparent from the following description of the 

embodiments thereof, and from the claims. 

Definitions 

For purposes of the present invention, the following terms used in this application are 
25 defined as follows: 

"web" means a sheet of material having a fixed dimension in one direction and either 
a predetermined or undetermined length in the orthogonal direction; 

"fiducial mark" means a symbol or numerical identifier used to uniquely identify a 
particular position ; "application specific" means defining product requirements based on its 
30 intended use; and 
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"anomaly" or "anomalies" mean a deviation from normal product that may or may not 
be a defect, depending on its characteristics and severity. 

Brief description of the drawing 
5 In the several figures of the attached drawing, like parts bear like reference numerals, 

and: 

Fig. 1 illustrates a schematic view of an exemplary system according to the present 
invention; 

Fig. 2 illustrates a convenient form for a fiducial mark used in connection with the 
10 present invention; and 

Fig. 3 illustrates a perspective view of a portion of a web marker suitable for use in 
connection with the present invention. 

Detailed description 

15 Referring now to FIG. 1 , a schematic view of the flow of information and material 

through an exemplary method 20 according to the present invention is illustrated. The 
Apparatus and the method 20 associated with the practice of the present invention may 
generally be considered as two distinct modules, an inspection module 24, and marking 
module 26. It is not a requirement of the invention that the inspection module 24 and the 

20 marking module 26 be separated as illustrated in Fig. 1 , although many of the most preferred 
embodiments will be so arranged. 

The process begins at a first stage 28. The inspection module 24 is adapted to act on a 
web of material 30 moving in direction Dl. Many different sorts of web materials are suitable 
for use with the present invention, as will be discussed in greater detail below. 

25 It may be preferred to provide steering for the web 30 at the beginning of the 

inspection module 24 and, when this is the case an edge sensor 32 may be employed, its 
information feeding back into any convenient web steering mechanism. The web 30 is then 
directed below camera 34, which is positioned so as to be able to image web 30 where it is 
illuminated by lighting device 36. Although the figure illustrates the web illuminated by 

30 reflected light, transmitted or transflected light may also be employed. 
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Digital information from the camera 34 is directed to a processor 38 which processes 
the digital information with an initial algorithm to identify regions on the web 30 containing 
anomalies. In most of the preferred embodiments, the processor 38 uses a simple initial 
algorithm that can be run in real-time and is at least capable of identifying regions that are 
5 anomalous. The processor 38 then extracts identified regions from the digital information for 
later consideration. In these embodiments, the method includes making this consideration by 
analyzing the extracted identified regions with at least one subsequent algorithm to determine 
which anomalies represent actual defects with respect to the contemplated end use of the web. 
This analysis can be performed by the inspection module 24, or by the marking module 26, or 

10 by a suitable intermediate module, and depending on the exact application, advantages may 
accrue from any of these possibilities. Regardless, it is often preferred to store or buffer the 
identified regions prior to analyzing. 

In carrying out the method of the present invention, it is necessary to place fiducial 
marks 40 on the web 30 and then record positional information localizing the identified 

15 regions relative to these fiducial marks 40. The fiducial marks 40 may be placed on the web 
30 prior to entering the inspection module 24, in which case the processor 38 may be 
programmed to make note of them when they are imaged by camera 34. Alternatively, and as 
depicted in FIG. 1, the fiducial marks 40 may be added to the web 30 by a fiducial marker 42 
and integrated by the processor 38 into the positional information in an alternative manner. 

20 Whether the step of placing fiducial marks 40 on the web 30 is done before or after the step of 
imaging the web 30, the processor 38 records positional information localizing the identified 
regions relative to the fiducial marks 40. 

For some specialized end uses for the web 30, it may be preferred to place along the 
web's edge some mark corresponding to the location of either anomalies or identify defects. If 

25 this is the case, optional lateral marker 44 may be used to apply such marks. 

Once the web 30 has passed through the inspection module 24, an intermediate stage 
46 has been reached. At this point, the web 30 has been marked with fiducial marks 40, and 
at least one electronic map 50 (conceptualized in the Figure as a corresponding object) has 
been created to record positional information localizing the identified regions (conceptualized 

30 in the Figure with reference numeral 52) relative to the fiducial marks 40. At least one 
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electronic map 50 will exist, and possibly more than one (collectively 50a). More than one 
electronic map may exist if either the initial algorithm, or the optional subsequent algorithm(s) 
have at this time determined which anomalies represent actual defects with respect to more 
than one contemplated end use of the web. 
5 In most preferred embodiments of the present invention, a second intermediate stage 

54 will be reached wherein the web 30 has been wound on a core 56 for shipping to a 
convenient location for accomplishing the conversion of the web 30 into a form useful for a 
contemplated end use. Electronic maps 50 and/or 50a are also transmitted to the location 
where the conversion will be performed, illustrated in the figure in stylized form as a diskette 

10 58, although any convenient means of electronic transmission can be used. 

Regardless of whether optional intermediate stage 54 has occurred, the web 30 is 
placed in motion in direction D2 into a marking module 26. A web marker controller 60 is 
provided with at least one of the corresponding electronic maps 50 corresponding to that 
particular web 30. The web marking controller 60 addresses the optional step of analyzing the 

15 electronic map 50 with a subsequent algorithm(s) to determine which anomalies represent 
actual defects with respect to the now contemplated end use of the web. 

The web 30 is first passed through a fiducial reader 62 for reading and providing 
localizing information from the fiducial marks 40. The fiducial reader 62 communicates this 
localizing information to the web marker controller 60. The web marker controller 60 

20 executes a program to form a plan to apply locating marks to the web identifying the position 
of at least some of the anomalies, using the positional information and the localizing 
information as a guide. The web marker controller then sends a series of commands to a web 
marker 64, which then applies locating marks 66 to the web 30. In keeping with the discussion 
above, in most embodiments of the invention only those anomalies that qualify as actual 

25 defects with respect to the contemplated end use of the web are identified with locating marks 
66. In many preferred applications of the present invention, the locating marks 66 are on or 
adjacent to the anomalies whose position they identify. However, in some specialized 
applications the locating marks 66 are spaced in a predetermined way from the anomalies 
whose position they identify. 
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Referring now to FIG. 2, a convenient form for a fiducial mark 40 used in connection 
with the present invention is illustrated. These marks are placed at regular intervals 
throughout the length of the web. The complete fiducial mark 40 includes one or more 
fiducial locating marks 82,84 which exactly locate a particular position within the web and a 
5 barcode 80 which conveniently encodes a unique identifier for each fiducial locating mark 
82,84. Thus, the fiducial marks 82,84 accurately locate a position and the barcode uniquely 
identifies that position so that the electronic map can be re-synchronized to the physical web 
during the marking operation. 

FIG. 3 is a perspective view of a portion of one example of a web marker 64 suitable 

10 for use in the present invention. The web marker 64 includes a frame 86 and mounting cable 
connectors 88 for communication with other apparatus including the web marker controller 60 
(not shown). Also mounted on the frame 86 are a series of ink-jet modules 90, each having a 
series of jet nozzles 92 thereon. The ink-jet modules 90 are conveniently mounted in 
staggered position in two rows so that coverage across the width of even a wide web can be 

15 provided in such a way that a malfunction can be addressed by the replacement of the single 
errant ink-jet module 90, rather than disassembly of the entire mechanism. The actual 
operating mechanics of the ink-jet modules 90 is conventional as understood by practitioners 
in an art. 
Web Materials 

20 In accordance with the present invention, the continuously moving web may include 

any sheet-like material that has a predetermined width and thickness and either an 
undetermined or predetermined length. Materials provided in web form that may be optically 
imaged are suitable for use with the present invention. Examples of web materials include, but 
are not limited to, metals, paper, wovens, non-wovens, glass, polymeric films or combinations 

25 thereof. Metals may include such materials as steel or aluminum. Wovens generally include 
various fabrics. Non-wovens include materials, such as paper, filter media, or insulating 
material. Films include, for example, clear and opaque polymeric films including laminates 
and coated films. 

One type of inspection problem particularly suitable to resolution through use of the 
30 present invention is the inspection of optical films. With films intended for, e.g. the surface of 



a computer display, where subtle defects can loom large to a user who is looking at the display 
for hours at a time. Sometimes defining exactly what sort of defect in this sort of application 
will be unacceptably burdensome to the user, and what sort of defect is harmless is quite 
complex. A scheme for reducing the complexity of the determination is presented with more 
5 particularity below. 

A second type of inspection problem is the inspection of flexible circuit webs. The 
invention is particularly suited for dealing with the complexity involved where individual 
circuits on a flexible circuit web have repeating circuit patterns deposited or formed on a 
flexible substrate. A web typically has multiple individual circuits each including various 

10 small parts arranged in arbitrary patterns. The individual circuits are later separated from the 
web by e.g. die cutting for use in discrete electrical applications. 

For many applications suited for the present invention, the web materials or combined 
materials may preferably have an applied coating. Coatings that may be optically imaged are 
suitable for use with the present invention. The coatings are generally applied to an exposed 

15 surface of the base web material. Examples of coatings include adhesives, optical density 
coatings, low adhesion backside coatings, metalized coatings, optically active coatings, 
electrically conductive or nonconductive coatings, or combinations thereof. The coating may 
be applied to at least a portion of the web material or may fully cover a surface of the base 
web material. 

20 Image Acquisition 

The image acquisition is accomplished through the use of conventional imaging 
devices that are capable of reading a sequential portion of the moving web and providing 
output in the form of a digital data stream. For purposes of the invention, the imaging device 
may include a camera that directly provides a digital data stream or an analog camera with an 

25 additional analog to digital converter. Furthermore, other sensors, such as for example, laser 
scanners may be utilized as the imaging device. A sequential portion of the web indicates that 
the data is preferably acquired by a succession of lines. The lines comprise an area of the 
continuously moving web that optically map to one or more rows of sensor elements or pixels. 
Examples of devices suitable for acquiring the image include linescan cameras such as 

30 Model#LD21 from Perkin Elmer (Sunnyvale, Calif), Piranha Models from Dalsa (Waterloo, 
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Ontario, Canada) , or Model#TH78H15 from Thompson-CSF (Totawa, N.J.). Additional 
examples include laser scanners from Surface Inspection Systems GmbH (Munich, Germany) 
in conjunction with an analog to digital converter. 

The image may be optionally acquired through the utilization of optic assemblies that 
assist in the procurement of the image. The assemblies may be either part of a camera, or may 
be separate from the camera. Optic assemblies utilize reflected light, transmitted light, or 
transflected light during the imaging process. 
Anomaly or Defect Detection 

After acquisition, images are processed using either conventional defect detection 
processing or using techniques disclosed in the copending and coassigned U.S. patent 
application 10/669,197, "Apparatus And Method For Automated Inspection Of Moving Webs 
By Reprocessing Image Information" (Attorney Docket No. 58695US002), which has been 
previously incorporated by reference in its entirety. The latter technique generally employs a 
system that performs a preliminary examination with a first, typically less sophisticated 
algorithm. The preliminary examination produces image information about the regions of the 
web containing anomalies. Some of the anomalies will be defective, but many could be "false 
positives", or anomalies that are not defective. In fact, some areas may be defective if the 
product is used in a particular application, but not defective if it is used in another. To 
effectively separate actual defects from anomalies, the original image information is 
reconsidered later and subjected to at least one of a variety of more sophisticated image 
processing and defect extraction algorithms. 

Defect detection algorithms or anomaly detection algorithms employed in the present 
invention include those conventionally utilized in the field of web inspection. Those skilled 
in the art of establishing web inspection systems are cable of matching one or more algorithms 
with specific web and defect types to achieve a desired accuracy level of defect detection. 
Non-limiting examples of suitable algorithms include neighborhood averaging, neighborhood 
ranking, contrast expansion, various monadic and dyadic image manipulations, digital 
filtering such as Laplacian filters, Sobel operators, high-pass filtering and low-pass filtering, 
texture analysis, fractal analysis, frequency processing such as Fourier transforms and wavelet 
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transforms, convolutions, morphological processing, thresholding, connected component 
analyses, blob processing, blob classifications, or combinations thereof. 

In a preferred embodiment, anomaly detection is employed at a first stage of the 
process using a selected algorithm to produce an electronic map. The web of material is 
5 wound up into a final roll during this processing step. The electronic map and the web are 
subsequently inspected in light of a desired end use. The anomalies that are truly defects for 
the desired end are identified on the web with location marks, as further described below. 

Anomaly or Defect information extracted from the image information is saved in a 
convenient data storage mechanism for later transfer and utilization in the marking process. 
10 Examples of storage mechanisms include various computer file and database formats. A 
preferred method utilizes a database such as Microsoft SQL Server from Microsoft Inc., 
Redmond, WA. 

Fiducial Marking 

15 The fiducial marks and associated barcodes may be imprinted on the web material 

using many different methods including ink marking, laser printing, mechanical impressioning 
devices, or other similar methods. It is important that the marks can be reliably applied and 
production web speeds and that the marks are easily sensed and the barcodes easily read 
during successive operations. An example of a suitable printing device is Model 6800 Ink Jet 

20 Printer from Linx Printing Technologies (Cambridgeshire, UK) and a suitable barcode reader 
is Model 530 from DVT Corporation (Duluth, Georgia). 
Defect Location Marking 

At some time after the initial inspection and application of fiducial locating marks, the 
product's defects as determined by the inspection system can be marked so as to allow for 

25 easy identification and removal. Depending on the web material and production conditions, 
many different marking mechanisms and marking configurations may be appropriate. 
However, methods of marking preferably have the capability of applying the defect mark 
sufficiently close the to the location of the actual product defect on the web. Arrayed markers 
have proven particularly effective, but position controlled markers are also suitable. A 
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particularly convenient method for film products utilizes an array of ink markers such as 
model MS610 from Matthews of Pittsburg, Pennsylvania. 

As the web passes through the system during the marking operation, fiducial marks are 
regularly sensed and associated barcodes read. The combination of barcode and fiducial mark 
5 enables one to precisely register the physical position of the web to the anomalies or defects 
identified in the electronic map. Regular re-registration ensures ongoing registration 
accuracy. One skilled in the art is capable of establishing the re-registration through 
conventional physical coordinate transformation techniques. Since the physical web is now 
registered to the electronic map, the physical position of specific anomalies or defects is 

10 known. In the instance where the physical position of defects or anomalies subsequently 

identified as true defects pass under the marking unit, marks are applied to the web. The type 
of mark and the exact position of the mark on or near the defect may be selected based upon 
the web material, defect classification, web processing required to address the defect, and the 
intended end use application of the web. In the case of the arrayed ink marker, markers are 

15 fired preferentially depending on their crossweb position as defects pass the unit in the 
downweb direction. With this method, marking accuracies of less than 1mm have been 
regularly achieved on high-speed webs with production rates greater than 150 ft/minute. 
However, higher speed webs in excess of 1000 meter/minute are within the capability of the 
invention. 

20 

Example 1 

A model 6800 Lynx printer was adapted to print along the edge of a web so as to serve 
as a fiducial marker, and was used to print fiducial marks on a moving polymeric web. Each 
of these fiducial marks included a bar-code and a fiducial position generally as depicted in 
25 Figure 2. The polymeric web was formed from transparent polyester 5 mils thick, 
commercially available from 3M Company, St. Paul, MN. 

The web, bearing its fiducial marks, was then directed to an inspection module that 
imaged sequential portions of the web. This imaging was accomplished by a model 
AT71XM2CL4010-BA0 camera, commercially available from Atmel of San Jose, CA. The 
30 web was viewed backlit by a lighting module commercially available from Schott-Fostec, 
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LLC, of Alexandria, VA. Digital information from the camera was sent to a model Precision 
530 digital computer, commercially available from Dell Computer Corp. of Round Rock, TX. 
There it was processed with an initial algorithm to identify regions on the web containing 
anomalies. The camera also brought to the digital processor information concerning the 
5 fiducial marks. The digital processor then extracted information concerning the identified 
regions and recorded positional information localizing the identified regions relative to the 
fiducial marks. The positional information was stored to magnetic media, and the web was 
wound onto a spool for later processing. 

10 Example 2 

The web of example 1 was placed in motion, unwinding from its spool in the reverse 
direction from which it was wound. It was directed past a fiducial reader including a model 
Legend 530 camera, commercially available from DVT of Duluth, GA. Positional control over 
the web as it passed by the fiducial reader was provided by a servo position controller 

15 commercially available from Accuweb of Madison WI, based on information from the web 
edge sensor commercially available as model 1.5X3U 4043-01, also from Accuweb. The 
illumination of the web at the fiducial reader was provided by a backlight module 
commercially available from Advanced Illumination of Rochester, VT. The output of the 
camera was directed to a web marker controller comprising a model Precision 530 digital 

20 computer, commercially available from Dell Computer Corp., so that information localizing 
the fiducial marks on the web could be obtained. 

The processor in the web marker controller was also provided with the recorded 
positional information obtained in Example 1. The web marker controller combined in the 
recorded positional information with the localizing information from the fiducial reader to 

25 form an electronic map of the location of web anomalies. 

The web was then directed under a web marker generally constructed as depicted in 
Figure 3. In this web marker, ink jet modules commercially available as model MS610 from 
Matthews of Pittsburg, Pennsylvania were mounted on a frame in two staggered rows and 
were placed under the control of the web marker controller. When according to the electronic 

30 map of web anomalies, an anomaly was passing under the web marker, a small jet of black ink 
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was expelled from the appropriate jet module onto the web to identify the location of the 
anomaly. During some runs, the web marker controller was programmed to direct the web 
marker to place a mark adjacent the web edge at the predictable distance in a machine 
direction sense compared to the anomaly. In other experiments, the mark was placed directly 
on the anomaly. In these latter cases, during the rewind of webs up to 2000meters in length, 
positional accuracy errors in placing the mark on the anomaly of no more than 1 mm was 
obtained. 

Example 3 

The web according to Example 1 was moved and marked generally according to 
description in Example 2, except that the web marker controller was provided with a 
subsequent algorithm designed to use distinguish actual defects rendering that portion of the 
web unsuitable for a particular contemplated end-use from other anomalies among the 
extracted information in the electronic map. During the run, the web marker controller was 
further programmed to send commands to the web marker to place locating marks on only 
those anomalies that qualified according to the subsequent algorithm as actual defects. 

Various modifications and alterations of the present invention will be apparent to those 
skilled in the art without departing from the scope and spirit of this invention, and it should be 
understood that this invention is not limited to the illustrative embodiments set forth herein. 
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